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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 13 November 2007 . 
2a)El This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) E3 Claim(s) See Continuation Sheet is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) BI Claim(s) 1. 3-15. 17-25. 27-39. 41-49. 51-63. 65-73. 75-87. 89-97. 99. 101. 35 U.S.C. 5 103. 105, 107, 109 and 
111 is/are rejected. 

7) [X] Claim(s) 16,40,64 and 88 is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/ are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
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2.D Certified copies of the priority documents have been received in Application No. . 
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Response to Amendment 

1. In response to the Office Action mailed 13 July 2007, applicant submitted a response 
filed 13 November 2007, in which the applicant amended claims 1, 3-4, 8, 17, 20, 25, 27-28, 32, 
41, 44, 49, 51-52, 56, 65, 68, 73, 75-76, 80, 89, 92, 97, 99, 101, 103, 105, 107, 109 and 1 1 1 
without adding new matter. Applicant has cancelled claims 2, 26, 50, 74, 98, 100, 102, 104, 106, 
108, 110 and 112. 

The Examiner thanks applicant for amending the claims to correct formal issues. 

Response to Arguments 

2. Applicant's arguments filed 13 November 2007 have been fully considered but they are 
not persuasive. 

In response to applicant's argument that the examiner's conclusion of obviousness is 
based upon improper hindsight reasoning, it must be recognized that any judgment on 
obviousness is in a sense necessarily a reconstruction based upon hindsight reasoning. But so 
long as it takes into account only knowledge which was within the level of ordinary skill at the 
time the claimed invention was made, and does not include knowledge gleaned only from the 
applicant's disclosure, such a reconstruction is proper. See In re McLaughlin, 443 F.2d 1392, 
170 USPQ 209 (CCPA 1971). 

In this case, the incorporation of Banbrook into the system of Coorman is merely 
detailing known matrix operations, which Coorman states is possible, but fails to specifically 
disclose. In addition, the Examiner asserts the zero-padding operation as taught in Ansari is a 
well-known technique in matrix manipulation that would have been obvious to one possessing 
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ordinary skill in the art at the time of invention. With respect to the Bellegarda paper as a 
reference, the Examiner disagrees with applicant's assertion of hindsight reasoning based at least 
on the fact that the paper was authored by applicant and cited as a reference containing particular 
relevance to the instant application. 

For these reasons, the Examiner maintains the proper combination of Coorman in view 
of Banbrook and Ansari. The Examiner asserts that at least the operations cited in Banbrook 
would have been obvious to try in an effort to reconstruct speech in such a way that would 
produce desired results stemming from ordinary skill and common sense rather than technical 
innovation. 

Claim Rejections - 35 USC §103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the • 
manner in which the invention was made. 

4. Claims 1-8, 19-20, 25, 27-32, 43-44, 49, 51-56, 67-68, 73, 75-80, 91-92, 97, 99, 101, 103, 
105, 107, 109 and 1 1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over Coorman 
in view of Michael Banbrook, 'Nonlinear Analysis of Speech From a Synthesis Perspectives 
A thesis submitted for the degree of Doctor of Philosophy at The University of Edinburgh; 
October 15, 1996 (Specifically Chapter 4), referred to as Banbrook hereinafter. 

Claims L 25, 49 and 73 : Coorman discloses a method for analyzing speech for use in 
synthesis, comprising: 
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i. extracting portions from time-domain speech segments (col. 5, lines 28-30) wherein the 
time-domain samples include pitch periods surrounding a boundary of a phoneme (col. 19, lines 
1-9); 

ii. creating feature vectors (col. 5, lines 28-30) that represent the portions in a vector 
space; and 

iii. determining a distance between the feature vectors in the vector space (col. 18, lines 

16-19). 

However, Coorman fails to, but Banbrook does specifically disclose wherein features 
include phase information of the portions (p. 37, The data is projected onto a phase space 
defined by the singular vectors of the data, which can then be partitioned into a signal subspace 
and a noise subspace. *) and wherein creating feature vectors comprises constructing a matrix W 
from the portions (col. 18, lines 21-23, The calculation of this spectral mismatch is based on a 
distance calculation between spectral vectors . This might be a heavy task as there can be many 
segment combinations possible. In order to reduce the computational complexity a combination 
matrix-containim the spectral distances- could be calculated in advance . ' [emphasis added]). 

However, Coorman recites performing operations on said matrix, however failing to, but 
Banbrook does specifically disclose decomposing the matrix W (p. 37, The method of singular 
value decomposition (SVD) reduction, described by Broomhead and King [85, 103], addresses 
this problem. ')• 

Therefore, it would have been obvious to one having ordinary skill in the art at the time 
of invention to include the teachings of Banbrook in the system of Coorman because it 
introduces a combination of analysis tools (e.g. time delay embedding, singular value 
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decomposition, correlation dimension, local singular value analysis, Lyapunov spectra and short 
term prediction properties) and looks in detail at Lyapunov exponents and two major novel 
modifications are proposed that are demonstrated to be more robust than conventional techniques 
(Abstract). 

Claims 3. 27. 51 and 75 : Coorman discloses a system as per claims 1, 25, 49 and 73 
above, further comprising extracting global boundary-centric features from the portions (col. 10, 
lines 49-54). 

Claims 4. 28, 52 and 76 : Coorman discloses a system as per claims 1, 25, 49 and 73 
above, wherein the speech segments each include a segment boundary within a phoneme (col. 9, 
lines 5-8). 

Claims 5, 29. 53 and 77 : Coorman discloses a system as per claims 4, 28, 52 and 76 
above, wherein the speech segments each include at least one diphone (col. 9, lines 5-8). 

Claims 6, 30, 54 and 78 : Coorman discloses a system as per claims 5, 29, 53 and 77 
above, wherein the portions include at least one pitch period (col. 19, lines 7-9). 

Claims 7, 31, 55 and 79 : Coorman, in view of Banbrook disclose a system as per claims 

6, 30, 54 and 78 above. However, Coorman fails to, but Banbrook does specifically disclose 

wherein decomposing the matrix W comprises performing a pitch synchronous (p. 37, 'which 

can then be partitioned into a signal subspace and a noise subspace. ') singular value analysis on 

* 

the pitch periods of the time-domain segments (p. 37, The method of singular value 
decomposition (SVD) reduction, described by Broomhead and King [85, 103], addresses this 
problem. '). 
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Therefore, it would have been obvious to one having ordinary skill in the art at the time 
of invention to include the teachings of Banbrook in the system of Coorman because of the 
reasons described above. 

Claims 8, 32, 56 and 80 : Coorman, in view of Banbrook disclose a system as per claims 
6, 30, 54 and 78 above. However, Coorman fails to, but Banbrook does specifically disclose 
wherein the matrix W is a 2KMx N matrix represented by 

W= UEV T 

where K is the number of pitch periods near the segment boundary extracted from each segment, 
Nis the maximum number of samples among the pitch periods, Mis the number of segments in a 
voice table having a segment boundary within the phoneme, U is the 2KMx R (p. 37, N x w 
trajectory matrix found utilizing time delay embedding) left singular matrix with row vectors w, 
(1 <i< 2KM), ZhXhzRxR diagonal matrix of singular values si > s 2 > . . . > s R > 0, Vis the Nx 
R right singular matrix with row vectors v, (1$ <N), R« 2 KM, and T denotes matrix 
transposition, wherein decomposing the matrix ^comprises performing a singular value 
decomposition of W(p. 37-38, X= SZC T , where X is the trajectory matrix, S and C are the 
matrices of the singular vectors associated with E f which is a diagonal matrix. ). 

Therefore, it would have been obvious to one having ordinary skill in the art at the time 
of invention to include the teachings of Banbrook in the system of Coorman because of the 
reasons described above. 

Claims 19, 43, 67 and 91 : Coorman discloses a system as per claims 5, 29, 53 and 77 
above, wherein the portions include centered pitch periods (col. 19, lines 7-9, 'In the preferred 
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embodiment the length of the trailing and leading regions are of the order of one to two pitch 
periods and the sliding window is bell-shaped [i.e. centered], 

Claims 17-18, 41-42, 65-66 and 89-90 : Coorman discloses a system as per claims 1, 25, 
49 and 73 above, wherein said distances are associated with said speech segments (units, col. 11, 
section 'Cost Functions', lines 46-49, f a set of nonlinear cost functions has been defined for use 
in the unit selection... with specific properties which help in the unit selection process. '). 

Claims 20, 44. 68 and 92 : Claims 20, 44, 68 and 92 are similar in scope and content to 
that of claim 8 above and so therefore are rejected under the same rationale. 

Claims 97, 10L 105 and 109 : Coorman discloses a system of determining 
discontinuities, comprising: 

i. gathering time-domain samples from recorded speech segments (col. 20, lines 17-22, 
The database may directly contain digitally sampled waveforms, or it may include pointers to 
such waveforms, ' [emphasis supplied]) wherein the time-domain samples include pitch periods 
surrounding a boundary of a phoneme (col. 1 9, lines 1-9); 

ii. extracting features that represent the samples (col. 4, lines 23-25, The acoustic join 
cost is based on a quantization of the mel-cepstrum, '); 

iii. determining a discontinuity between the segments (col. 12, 'Cost Functions for 
Numeric Features', 'Imprecise linguistic or acoustic knowledge, for example, how big a 
discontinuity in pitch can be perceived, '), the discontinuity based on a distance between the 
features ( Tor example, the mismatch of pitch between phones with the same accentuation (either 
both accented, or both unaccented) in the Transition Cost has a symmetric cost function... '). 
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However, Coorman fails to, but Banbrook does specifically disclose wherein features 
include phase information of the portions (p. 37, The data is projected onto a phase space 
defined by the singular vectors of the data, which can then be partitioned into a signal subspace 
and a noise subspace, ') and wherein creating feature vectors comprises constructing a matrix W 
from the portions (col. 18, lines 21-23, The calculation of this spectral mismatch is based on a 
distance calculation between spectral vectors . This might be a heavy task as there can be many 
segment combinations possible. In order to reduce the computational complexity a combination 
matrix-containing the spectral distances- could be calculated in advance . ' [emphasis added]). 

However, Coorman recites performing operations on said matrix, however failing to, but 
Banbrook does specifically disclose decomposing the matrix W (p. 37, The method of singular 
value decomposition (SVD) reduction, described by Broomhead and King [85, 103], addresses 
this problem. '). 

Therefore, it would have been obvious to one having ordinary skill in the art at the time 
of invention to include the teachings of Banbrook in the system of Coorman because it 
introduces a combination of analysis tools (e.g. time delay embedding, singular value 
decomposition, correlation dimension, local singular value analysis, Lyapunov spectra and short 
term prediction properties) and looks in detail at Lyapunov exponents and two major novel 
modifications are proposed that are demonstrated to be more robust than conventional techniques 
(Abstract). 

Claims 99, 103, 107 and 111 : Coorman discloses a system as per claims 98, 102, 106, 
and 110 above. However, Coorman fails to, but Banbrook does specifically disclose wherein 
features include phase information of the portions (p. 37, The data is projected onto a phase 
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space defined by the singular vectors of the data, which can then be partitioned into a signal 
subspace and a noise subspace. '). 

Therefore, it would have been obvious to one having ordinary skill in the art at the time 
of invention to include the teachings of Banbrook in the system of Coorman because of the 
reasons described above. 

5. Claims 9-10, 21-23, 33-34, 45-47, 57-58, 69-71, 81-82 and 93-95 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Coorman, in view of Banbrook and in further view of 
Ansari et al., 'Pitch Modification of Speech Using a Low-Sensitivity Inverse Filter 
Approach'; IEEE Signal Processing Letters; March 1998 referred to as Ansari hereinafter. 

Claims 9, 33, 57 and 81 : Coorman, in view of Banbrook disclose a system as per claims 
8, 32, 56 and 80 above, however failing to, but Ansari does specifically disclose padding a 
signal with zeroes (p. 61, section III, 'in the new method when the residual is modified with zero- 
padding to lower the pitch. '). 

Therefore, it would have been obvious to one having ordinary skill in the art at the time 
of invention to include the teachings of Ansari in the system of Coorman, in view of Banbrook 
because speech modifications using the method of Ansari are superior in quality to those 
obtained with RELP, while at the same time being less sensitive than RELP to errors in pitch 
marking (Abstract). 

Claims 10, 34, 58 and 82 : Coorman, in view of Banbrook disclose a system as per 
claims 9, 33, 57 and 81 above. However, Coorman fails to, but Banbrook does specifically 
disclose wherein a feature vector w, is calculated as 
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where w z is a row vector associated with a pitch period i, and L is the singular diagonal matrix 
(p.49, 'In general any matrix A can be written A = QR (4. J 7) where Q has orthogonal columns 
andR is a square upper-right triangular matrix with positive values on the diagonal '). 

Therefore, it would have been obvious to one having ordinary skill in the art at the time 
of invention to include the teachings of Banbrook in the system of Coorman because of the 
reasons described above. 

Claims 21 45, 69 and 93 : Coorman, in view of Banbrook disclose a system as per 
claims 20, 44, 68 and 92 above, however failing to, but Ansari does specifically disclose 
symmetrically padding a signal with zeroes (p. 61, section III, 'in the new method when the 
residual is modified with zero-padding to lower the pitch. '). It would have been obvious to one 
having ordinary skill in the art that if pitch periods were centered, that one would be motivated to 
append zeros symmetrically on either side of the centered samples in order to maintain 
symmetric proportions with respect to a centered pitch. 

Claims 22-23. 46-47, 70-71 and 94-95 : Claims 22-23, 46-47, 70-71 and 94-95 are similar 
in scope and content to that of claims 10 and 12 above and so therefore are rejected under the 
same rationale. 

6. Claims 11-15, 35-39, 59-63 and 83-86 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Coorman and Banbrook in view of Ansari and in further view of Jerome R. 
Bellegarda, 'Exploiting Latent Information in Statistical Language Modeling' referred to as 
Bellegarda hereinafter. 
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Claims 1L 35, 59 and 83 : Coorman and Banbrook in view of Ansari disclose a system 
as per claims 10 3 34, 58 and 82 above. However, Coorman and Banbrook in view of Ansari 
fail to, but Bellegarda does specifically disclose wherein the distance between two feature 
vectors is determined by a metric comprising the cosine of the angle between the two feature 
vectors (p. 5, We conclude that a natural metric to consider for the "closeness" between words 
is therefore the cosine of the angle between and Uj. '). 

Therefore, it would have been obvious to one having ordinary skill in the art at the time 
of invention to include the teachings of Bellegarda in the system of Coorman and Banbrook in 
view of Ansari because it uses latent semantic analysis to improve statistical language modeling 
utilizing existing clustering techniques capable of aiding in speech production by machine 
(Introduction). 

Claims 12, 36. 60 and 84 : Coorman and Banbrook in view of Ansari disclose a system 
as per claims 10, 34, 58 and 82 above. However, Coorman and Banbrook in view of Ansari 
fail to, but Bellegarda does specifically disclose wherein the metric comprises a closeness 
measure, C, between two feature vectors, u k and «/, wherein C is calculated as 

v»2 r 



formy l<k, I <2KM(p. 6,(10)). 

Therefore, it would have been obvious to one having ordinary skill in the art at the time 
of invention to include the teachings of Bellegarda in the system of Coorman and Banbrook in 
view of Ansari because of the reasons described above. 
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Claims 13. 37. 61 and 85 : Coorman and Banbrook in view of Ansari and in further 
view of Bellegarda disclose a system as per claims 12, 36, 60 and 84 above. The examiner is 
taking Official Notice that the difference as calculated by 

d(S u Si) - d 0 (px, qi) » 1 - C(«pi , ) 
is simply a natural extension from the closeness measure as determined in the prior claim (which 

is assumed to be a value between 0 and 1). Therefore, it would have been obvious to one having 

ordinary skill in the art at the time of invention to include a difference measure as the counterpart 

to a closeness measure previously determined because it is well known that the two factors have 

an inversely variable relationship, here adding up to 1 . 

Claims 14, 38. 62 and 86 : Coorman discloses a system as per claims 13, 37, 61 and 85 
above, wherein the calculation for the difference between two segments in the voice table, SI 
and S2, is expanded to include a plurality of pitch periods from each segment (col. 19, lines 1-9). 

Claims 75, 39, 63 and 87 : Coorman discloses a system as per claims 13, 37, 61 and 85 
above, wherein the difference between two segments in the voice table, Si and S2, is associated 
with a discontinuity between Si and S2 (col. 18, lines 48-54, The major concern of waveform 
concatenation is in avoiding waveform irregularities such as discontinuities and fast transients 
that may occur in the neighborhood of the join... It is thus important to minimize signal 
discontinuities at each junction. '). 
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Allowable Subject Matter 
7. Claims 16, 40, 64 and 88 are objected to as being dependent upon a rejected base claim, 
but would be allowable if rewritten in independent form including all of the limitations of the 
base claim and any intervening claims. 

The above claims recite a specific distance formula as follows: 

d(S tt S 7 ) * | d&uqi) -dfrupd + dtquqd l* \ Cjuptjm) + C(u q x >uy) - C{u P i ,i7*i ) | 

2 2 

The above is used as an alternative distance measure that is essentially the relative change in 
similarity that occurs during a concatenation function. More specifically, this alternative 
distance specifically shows wherein a difference is zero only when two identical segments are 
concatenated together; otherwise a difference measure greater than zero exists. While the cited 
prior art references do use distance measures as disclosed, none of the references use an 
alternative distance measure as specifically disclosed and defined as per claims 16, 40, 64 and 
88. 

Conclusion 

8. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 



Application/Control Number: 



Page 14 



10/693,227 
Art Unit: 2626 

will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Justin W. Rider whose telephone number is (571) 270-1068. The 
examiner can normally be reached on Monday - Friday 7:30AM - 5:00PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David R. Hudspeth can be reached on (571) 272-7843. The fax phone number for 
the organization where this application or proceeding is assigned is 57 1-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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14 January 2008 




